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Method for processing video pictures for display on a dis- 
play device 

The invention relates to a method for processing video pic- 
5 tures for display on a display device* 

More specifically the invention is closely related to a kind 

of vid e o proc es sing for improving the picture quality of 

pictures which are displayed on matrix displays like plasma 
display panels (PDP) or other display devices where the 

10 pixel values control the generation of a corresponding num- 
ber of small lighting pulses on the display. 

The Plasma technology now. -makes it possible to achieve flat 
color panel of large size (out of the CRT limitations) and 
15 with very limited depth without any viewing angle con- 
straints. 

Referring to the last generation of european. TV, a lot of 
work has been made to improve its picture quality. Conse- 
quently/ a new technology like the Plasma one has to provide 

20 a picture quality as good or better than standard TV tech- 
nology. On one hand, the Plasma technology gives the possi- 
bility of "unlimited" screen size, of attractive thickness 
. . . but on the other hand, it generates new kinds of arte- 
facts which could degrade the picture quality. 

25 Most of these artefacts are different as for TV picture and 
that makes them more visible since people are used to seeing 
old TV artefacts unconsciously. 

The artefact, we will study here, is called "dynamic false 
contour effect" since it corresponds to disturbances of gray 
'30 levels and colors in the form of an apparition of colored 
edges in the picture when an observation point on the PDP 
screen moves. The degradation is most visible when the image 
has a smooth gradation like skin. . . 

The next figure shows the simulation of such a false contour 
35 effect on a natural scene with skin areas : 
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In addition/ the same problem occurs on static images when 
observers are moving their heads and that leads to the con- 
clusion that such a failure depends on the human visual per- 
ception and happens on the retina.., 

A lot of algorithms today are based on motion estimator in 
order to be able to anticipate the motion of the eye to re- 
duce or suppress this false contour effect. However, these 
different algorithms provide solution for false contour 
without any information concerning the motion estimator 
used. 

In the past, the motion estimator evolution was mainly fo- 
cused on flicker-reduction for european TV (e.g. from 50Hz 
to 100Hz) or proscan conversion and for compression in the 
scope of MPEG-encoder and so one. Nevertheless, the problems 
which have to be solved for such applications are different 
from the PDP dynamic false contour issue. For that reason, 
we propose in this document a way to improve the quality of 
the false contour reduction using standard motion detectors 
with a post-processing of the estimated motion-vectors ac- 
cording to the human visual system. 
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A Plasma Display Panel (PDP) utilizes a matrix array of dis- 
charge cells which could only be "ON" or "OFF", Also unlike 
a CRT or LCD in which gray levels are expressed by analog 
control of the light emission, a PDP controls the gray level 
by modulating the number of light pulses per frame. This 
time-modulation will be integrated by the eye over a period 

corr e sponding to the eye time response . 

When an observation point (eye focus area) on the PDP screen 
moves, the eye will follow this movement. Consequently, it 
will no more integrate the same cell over a frame (static 
integration) but it will integrate information coming from 
different cells located on the movement trajectory and it 
will mix all these light pulses together which leads to a 
faulty signal information. 

Today, a basic idea to reduce this false contour effect is 
to detect the movements in the- picture (displacement of the 
eye focus area) and to apply different type of correction 
over this displacement in order to be sure the eye will only 
perceive the correct information through its movement. 
Nevertheless, in the past, the motion estimator evolution 
was mainly focused on other applications than Plasma tech- 
nology and the aim of a false contour compensation needs 
some adaptation above all in the use of the motion vectors 
coming- from the motion estimator. 

As already said, a dynamic false contour reduction will be 
applied on .a ..movement trajectory defined by the motion vec- 
tors. Nevertheless, since the panel is a matrix array of 
pixels, we need to convert a motion vector to a way in this 
matrix with the respect of the human visual system behavior. 
For that reason, we propose in this document a way to im- 
prove the quality of the false contour reduction using stan- 
dard motion detectors with a post-processing of the esti- 
mated motion- vectors according to the human visual system. 
It could be implemented for each kind of Plasma technology 
at each level of its development (even if the scanning mode 
and sub-field distribution is not wel_l_def Ined) ... . 
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Considering above artefacts, occurring on the retina, dif- 
ferent inventions based on a motion estimator exist in the 
literature today. All these inventions will used the motion 
vectors coming from the motion estimator to apply different 
kind of compensation. Nevertheless, there is no information 
about the way to use these motion vectors or about a possi- 

hility tn improve them . 

In fact, since a PDP is a matrix of pixel, each kind of cor- 
rection has to respect this matrix segmentation of the 
panel. Taking into account a motion vector, it will be used 
to determin in the matrix of pixel a trajectory to apply the 
compensation. For that purpose it is necessary to convert a 
vector in a discrete trajectory which can leads to faulty or 
partial compensation. 
15 In this invention, the characteristics of the human visual, 
system will be used to implement a post processing on the 
vectors coming from the motion estimator. That makes possi- 
ble to define a compensation trajectory respecting the human 
eye in order to improve the global quality of the compensa- 
20 tion. 

This algorithm improves the efficiency of each dynamic false 
contour correction based on a motion estimator since it bet- 
ter respects the behavior of the human visual system, 
This algorithm is very simple to implement since it does not 
25 request complicated computations 



30 



As previously said, a Plasma Display Panel (PDP) utilizes a 
matrix array of discharge cell which can only be "ON" or 
"OFF". The PDP controls the gray level by modulating the 
number of light pulses per frame. This time modulation will 
be integrated by the eye over a period corresponding to the 
human eye time -response. 

Let us assume, we want to dispose of 8 bit luminance levels, 
in that case each level will be represented by a combination 
of the 8 following bits : 
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1 -2-4-8-16-32-64-128 

To realize such a coding with the PDP technology, the frame 

period will be divided in 8 lighting periods (called sub- 
fields) , each one corresponding to a bit. The number of 
5 light pulses for the bit "2" is the double as for the bit 

"1"... With these 8 sub-periods, it is possible through com- 

bination, to build the 256 gray levels. Without motion/ the 

eye of the observers will integrate over about a frame pe- 
riod these sub-periods and catch the impression of the right 

10 gray level. The next figure presents this decomposition : 



16 ; 32 ! V 64 128 



Frame duration 
Time 5 



This light emission pattern introduces new categories of im- 
15 age-quality degradation corresponding to disturbances of 
gray levels and colors. These will be defined as dynamic 
false contour since the fact that it corresponds to the ap- 
parition of colored edges in the picture when an observation 
point on the PDP screen moves. Such failures on a picture 
20 leads to an impression of strong contours appearing on homo- 
geneous area like skin. The degradation is enhanced when the 
image has a smooth gradation and also when the light- 
emission period exceeds several milliseconds. 
In addition, the same" problems occur on static images when 
25 observers are moving their heads and that leads to the con- 
clusion that such a failure depends on the human visual per- 
ception. 

To understand a basic mechanism of visual perception of mov- 
ing images, a simple case will be considered. Let us assume 
30 a transition between the level 128 and 127 moving at 5 pixel 
per frame, the eye following this movement. 

The next figure represents in dark green the lighting sub- 
fields corresponding to the level 12 8 and in green, these . 
cor responding - - to the—level 127 r — — 



V 




On this last figure, we can follow the behavior of the eye 
integration during a movement. The two extreme diagonal eye- 
integration-lines show the limits of the faulty perceived 
signal. Between them, the eye will perceive a lack of lumi- 
nance which leads to the appearing of a dark edge like on 
the next figure : 



Amplitude 




2. Principle of dynamic false contour compensation 



The false contour effect is produced on the eye retina when 
5 the eye follows a moving object since it integrates right 
information at wrong places. There are different methods to 
reduce such an effect but the more serious ones are based on 
a motion estimator (dynamic methods) which aim to detect the 
movement of each pixel in a frame in order to anticipate the 
10 eye movement or to reduce the failure appearing on the ret- 
ina through different correction. 

In other words, the goal of each dynamic algorithm is to de- 
fine for each pixel locked by the eye, the way the eye is 
following the movement during a frame in order to generate a 
15 correction on this trajectory. 

Consequently, for each pixel of the frame N, we will dispose 

of a motion vector V = (V x ;V y ) which describes the complete 

motion of the pixel from the frame N to the frame N+l. Nev- 
ertheless, the goal of a false contour compensation is to 
20 apply a compensation on the complete trajectory. In other 

words, such an algorithm needs a way to convert this vector 
in a trajectory on a matrix display. 

Taking the example of a vector V = (7;3) , the next figure 
shows that the definition of this vector is not enough to 
25 determine one trajectory : 




Frame N 

On the previous figure, the vector represents the real mo- 
tion of a pixel, that means the real trajectory the eye will 
follow when it locks this pixel. The doted line represents a 



5 possible trajectory in the matrix array. Yet, there are dif- 
ferent other possible trajectories and it is necessary to 
define a trajectory as near as possible from the eye inte- 
gration trajectory. In order to do that, a better under- 
standing of the human visual system is recommendated. 

10 

3. Human visual system (HVS) : cortex areas 

The complete human visual system could be seen as a picture 
encoder to reduce the informations received by the retina to 
e s s entTilal~xrrf ormatfibns which couldTbe rapidly interpreted by 
15 the brain. 

For instance, the pupil could be seen as a low-pass filter 
which reduces the amount of high spacial frequencies. The 
goal of this document is not to make a complete exposition 
of the human visual system but to extraict some important 
20 characteristics from the HVS to explain the ideas included 
in this invention disclosure. 

One key point for us is the fact that the cortex areas will 
analyse the incoming picture with a discrete filter bank as 
described— in— the--fol~l~owin"g"p~i~cture~ : 



Cerebral cortex 




This last. figure shows that the signal coming from the eye 
will be analyzed between preferential directions and the 
number of these direction is limited (discrete analysis) . In 
order to measure the exitation intensity in each direction, 
each directional filter will be followed through a filter 
bank in spacial frequencies. 

In fact, medical experiments have shown that this decomposi- 
tion through a filter bank can be seen as a mathematical de- 
composition in gabor wavelets which are very near from the 
simple receptor fields of the cortex cells. 

The mathematics formula of such a gabor wavelet is the fol- 
lowing one : 

fo = «p(-*|(x-xJV +(y-y 0 fb 2 §xexv(-2ix[u 0 (x-x 0 )+v 0 (y-y 0 )]) where 
( x o>yo) represents the position of the filter modulated by 
the spacial frequencies (u o9 v 0 ) and with an orientation of 



arc 




The two following curves represents the aspect of such a ga- 
bor function. The first one representing a 3D aspect of the 
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gabor function, the second one representing a colored 2D as- 
pect of the same .function. 




These graphics shows how the eye will analyse an object 

transition or a movement in a special direction. 

Let us apply the 2D curve on the previous moving pixel with 

the vector F = (7;3) 



L Position 
Frame N+l 
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Position 
Frame N 
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On this previous picture, the middle area (directly arround 
the vector) represents the more sensitive one for the eye 
integration. Consequently, each kind of dynamic false con- 
tour compensation should be spread on this area which really 
define the compensation trajectory. 

The basic idea of the algorithm d e scribed in this docume n t 



is to define a vector post-processing method which enables 
such an adaptated compensation. 



4. Algorithm principle 

In theory, the different motion vectors could have any kind 
of values and so any kind of direction. 

4.1. The first stage is to convert the two vector components 
15 to an integer: 

The aim of each compensation is to reduce, in the right di- 
rection taking into account the right amplitude of the move- 
ment, the false contour effect. 

In fact, since the compensation has to be applied on a ma- 
20 trix array of pixels (discrete positions) , the two motion 

vector components have to be integer ones to apply a correc- 
tion on a discrete trajectory (defined with integers) . In 
that case, it is necessary to round the vector components 
coming from the motion estimator. Every kind of rounding can 
25 be foreseen. Nevertheless, experiments made on different 

available motion estimator shows that a -rounding down could 
improve the final result. In order to simplify the further 
. explanations a rounding down will be chosen for the rest of 
this document . 

30 It is obvious that a compensation which is based on a lower 
value of the movement amplitude but which respects the right 
direction will still provide a gain in the reduction of the 
false contour. On the other hand, if the compensated motion 
amplitude is too high, we will generate a false contour ef- 

35 feet in the opposite level to the effect we will try to com- 
pensate ._In__additipA, the^ fact, to jum p fr om an under- 
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compensation to an over-compensation will suddenly change 
the color of the false contour and that makes it more visi- 
ble. 

Consequently, for all computations one kind of rounding has 
5 to be precisely defined and an under-compensation (used mo- 
tion amplitude lower than the real one) will be chosen for 

further explanations. 

For that reason, the first stage of the algorithm will con- 
vert each vector component to an integer with a rounding 

10 down to the neariest lower integer: 

V A = V^ound I (V x \round I (fJ) . 



15 



4.2. Conversion of standard vectors to basic ones : 

Before to go further, an example of a improperly correction 

will be given to introduce the new computation methodology. 



Taking into account a 

simple correction based 

on 10 pixels in the 

case of a trajectory 

defined with the vector 
V = (7;3) the following 

correction could be 

faulty implemented : 

Position _ 
Frame N" 



7 



Position 
Frame N+l 



On this last figure, the number corresponds to one of the 
20 ten elements of the compensation. It is obvious that this 

compensation does not respect the symmetry of the human eye 
integration function and leads to a non-optimal false con- 
tour correction. 

In fact, we have seen in the paragraph 3. that the human 
25 cerebral cortex will- decompose each movement and stimuli in 
preferential directions. In fact, since the human visual 
system does not dispose of an infinite number of such direc- 
tions, those directions could be defined as discrete ones. 
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For that purpose one principle of the algorithm is to con- 
vert our vectors to a discrete number of direction (convert 
all vectors to simplest ones which leads to a more symmetri- 
cal compensation) . 
5 We have seen in the paragraph 4.1. that our vectors are 

based on integers and consequently, the direction given by 

each vectors is based on the ratio between th e two in te g e r 

vector components. 

In order to build a discrete space of directions, a good 
10 possibility is to define each vector as based on two compo- 
nents having an integer ratio inbetween. 

For that purpose, the second stage of the processing de- 
scribed here will correspond to a modification of the vector 
components as described below : 
15 select the smallest vector component: S = Tmn\f^ x ,V y ) 

compute the ratio R between S and the second component: 

V i \ 

R = -^- in which V x =max\V x ,V y ) 
S 

round the ratio R and then update the second vector compo- 
nent: V t '=round(R)xS 

20 For instance the vector V(l;3) will be converted to the vec- 
tor V'(6;3) and the vector f(2;9) will be converted to V'(2;S) . 
These two vectors are a part of a discrete space of vectors 
and their form leads to a better symmetry of the compensa- 
tion. 

25 Now, this processing will be illustrated through an example 
based on a Sub-field shifting algorithm. This algorithm is 
explained in detail in the European Patent applications 
98114883.6 and 99114587 . 1- of the applicant. For the disclo- 
sure regarding this algorithm it is therefore expressively 

30 referred to these patent applications. 

Taking into account as example a motion vector defined by 

V = 3,3.7) and the case of a 12 Sub-field coding described on 
the next picture : 
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16:; 32 ; i 32 ; 32 :j 32 ;; 32 ; 32 ; 32 

Frame Deriod 

Conversion of standard vector components to integers one 
F' = (7;3) 

Conversion of the new vector to a basic one 
K* = (6;3) 

Computation of the correction positions 

The main idea of the sub-field shifting algorithm is to an- 
ticipate the movement in order to position the different bit 
planes of the moving area on the eye integration trajectory. 
That means we will shift the different bit-planes depending 
on the eye movement to make sure the eye receive the right 
information at the right time. For that purpose we have de- 



Dur(ri) 



fined centers of gravity : G(ri) = ^Durji) + 

1=1 2 

in which G() represents the center of gravity location in 
the frame, n the current sub-field and Dur () the duration of 
the sub-field. This duration includes the addressing time as 
following : 
Dur(n) = Todd + Trt 

in which Tadd represents the duration of the addressing and 
Tn the duration of the sub-field itself. 

For instance, a result of such a computation should be : 




16:! 32 i! 32 



! 32 !! 32 II 32 II 32 



32 I 



Frame period (255 levels) 



255 



25 



Giving a motion vector V = (Vx;Vy), the new position of the 

sub-fields will be so calculated : Ax„ = and 

— : — Dur{F) 





— Sub-field N° / 


1 


7 


3 


4 


5 


6 


7 


8 


_9- 


10 


11 


12 






A* 


0.01 


0.05 


0.1 


0.26 


0.54 


1.1 


1.85 


2.6 


3.36 


4.1 


4.87 


5.6 








0.005 


0.02 


0.06 


0.13 


0.27 


0.55 


0.93 


1.3 


1.68 


2.05 


2.43 


2.8 
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Ay n = — — in which, Dur(F) represents the complete dura- 

Dur(F) 

tion of the frame. 

In our example where F = (6;3), we will find the following re- 
sults : 
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Compute how the correction will be applied 

Since a correction could only be applied at one single posi- 
tion defined by two coordinates in the matrix of pixel, we 
will have to round the previous computed values- Different 
kind of rounding process could be applied and for this exam- 
ple a round down process of each previous computed coordi- 
nates has been chosen to respect the choice of paragraph 4 . 1 
to make under-compensation (obviously over kind of compensa- 
tions are possible) : 



Sub-field N° / ] 


L 1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


Ax' 


0 


0 


0 


0 


0 


1 


1 


2 


3 


4 


4 


5 


Ay' 


0 


0 


0 


0 


0 


0 


0 


1 


1 


2 


2 


2 
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On the following picture, we can see the result of this com- 
pensation : 
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- Position 






Frame N+l 



j 



Position 
Frame N 

compared to a standard compensation based on V' = (7;3) in ' 

which we have implemented only a rounding down process : 



Sub-field N° 1 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


=— — 

Ax 1 


0.01 


0.05 


0.14 


0.3 


0.63 


1.29 


2.17 


3.05 


3.92 


4.8 


5.68 


6.56 


Ay' 


0.006' 


0.02 


0.06 


0.13 


0.27 


0.55 


0.93 


1.3 


1.68 


Z05 


2.43 


2.8 



fri jpi? ^ 



k Position 
Frame N+l 



Position 



7 



10 



Frame N 

A comparison of these two last figures shows that the second 
one does not respect the symmetry of the human visual sys- 
tem. In that case, the experience shows some artefact pro- 
duced by the compensation itself even in areas where no 
false contour is visible. In addition, when the vector space 
is discrete, the compensation stays more stable between two 
serious vector changes. 



Rrinted:O6^12-20(p 
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4.3. Case of correction made on amplitude basis : 
Today a lot of correction based on motion vectors will be 
applied on amplitude basis. In that case, one possibility is 
to add a positive or negative signal to the original pic- 
5 tures at different positions depending on the motion vectors 
(A lot of other kind of corrections could be find in the 

literature . . . ) . ; 

In that case, at each matrix position a combination of two 
or more corrections can be applied. Consequently, giving a 

10 correction, one or two positions for this correction can be 
defined in the matrix. 

Using the assumption of appliing a correction based on N 
elements to the trajectory defined by the vector V -^ x \V y ) . 
For instance, a simple way to compute the position P t = {& x ;£ y ) 



15 is defined by the formula 



A' x =ix^ and AV=ix^. 



Nevertheless, in order to respect the symmetry of the gabor 
function, a special rounding processing will be applied. 
This aims to produce an artificial symmetry in the compensa- 
tion. In that case, each compensation could be applied at 
one or two positions like described below : 

0% 50% 100% 



1°/ 




S% 








Use two 




— — 

Round down to 

An 


Round up to' 

^ * An+1 

positions 



An and An+1 

This last figures describe the following processing 



If A' = / x — ^ 1% x round t 
N 



then A' = round 4 
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I f 1% x round T x ^-j < A*, = i x ^- < S% x round t |i x then 



round <l J 
round t 



If A 1 , =/x^>5%xroiiwrftf/x^- > lthen A* = round t f / x — 1 

Obviously, the border 1% and S% could have different values 

depending on the compensation algorithm used. 

Let us illustrate this processing through a simple example 

in which the vector V = {& 9 3) and N=9. 
Case of I%=40% and S%=60% : 

The following table show the computation of the positions 
for the 9 corrections defined by ^=(A , r ;A , y ) 



10 



15 



Correction N° i 


1 


2 


3 


4 


5 


6 


7 


8 


9 




1 


1 


2 


3 


3 


4 


5 


5 


6 


! \' 


0 


1 


1 


1 


2 


2 


2 


3 


3 



In that case, the implementation of the correction will look 
like as on following figure : 



Position 
Frame N 



7 



h Position 
Frame N+l 



i 
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The numbers located in the different pixel blocks refer to 
the correction signals. 

Case of I%=30% and S%=70% : 

The following table show the new computation of the posi- 
tions for the 9 corrections defined by T t =(a' x ;A',) 



Correction N° / 


1 


2 


3 


4 


5 


6 


7 


8 


9 


A 1 

X 


0, 1 


1 


2 


2,3 


3 


4 


4,5 


5 


6 




0 


0, 1 


1 


1 


1,2 


2 


2 


2,3 


3 



10 The following figure shows how the compensation will look 
like : 
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- Position 






Frame N+l 



Position / 

Frame N 



Consequently, a change of the values from I and S will have 
an impact of the density of the correction on the movement 
trajectory. 

In fact, in the cells containing more than one correction, a 
combination of these corrections will be necessary and will 
depend of the correction type. 
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1. Method for processing video pictures for display on a 
display device having a plurality of luminous elements 
5 corresponding to the pixels of a picture, wherein the 

time duration of a video frame or video field is divided 
into a plurality or suiD-rieicis aurmg which trie luminous 
elements can be activated for light emission in small 
pulses corresponding to a sub-field code word which is 

10 used for brightness control, wherein motion vectors are 

calculated for pixels, characterized in that, the motion 
vector components are rounded to integer, values, wherein 
in the rounding step the components are rounded down ir- 
respective of their rational component value and wherein 

15 the motion vectors are used to determine corrected sub- 

field code words for dynamic false contour effect com- 
pensation* 
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2. Method according to claim 1, wherein the rounded motion 
vectors are converted to a more symmetrical form before 
they are used for sub-field code word correction. 



3. Method according to claims 2, wherein the following 
steps are used for motion vector conversion: 
25 first, the smallest motion vector component S" is 

selected where S=min(V x ,V y ) with V x and V y being the mo- 
tion vector components; 

second, the ratio R between S and the other motion 
vector component Vi is calculated, where R=Vi/S and 
30 V^maxlVx^y), with i e [x,y]; 

third, the ratio R is rounded and the other motion 
vector component Vi is updated according to the formula 
V' { = round{R) S . 




4. Method according to one of claims 1 to 3, wherein sub- 
field shifts are calculated for pixels in dependence of 
the corresponding motion vectors and wherein a rounding 
step is performed for- each sub-field shift component 

5 during sub-field shift calculation, wherein in the 

rounding step the sub- field shift components are rounded 

-down irrespective of their rational component value. 



5. Method according to one of claims 1 to 3, wherein a cor- 
10 rection value is calculated for a pixel on pixel level 

for dynamic false contour effect compensation and 
wherein the correction value is distributed among a num- 
ber of pixels which are determined by the calculated mo- 
tion vector. 
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6. Method according to claim 5, wherein the pixels 

Pj=(A! x ;A l y } which are used for correction value distribu- 

V V 
tion are defined by the formulae A' =/x- 7 and A' =/x — , 

N y N 

where N is a number according to the number of pixels 
20 over which the correction value is to be distributed 

corresponding to the length of the motion vector 

V = (v x ;V y ), where i is an index running from 1 to N, 

wherein a specific rounding process is used for correc- 
tion pixel~location, wherein if the rational component 
25 value of a vector component A x/ A'^ lies in a first 

range, the vector component is rounded down, wherein if 
the rational component value of a vector component lies 
in a- second range, the vector component is rounded up 
and down thus leading to two different correction posi- 
tions in parallel, and wherein if the rational component 
value of a vector component A' x , A^ lies in a third 
range, the vector component is rounded up. 

1 
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